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ABSTRACT 


This thesis presents an analytical study of time- 
sharing computer systems. Unlike the earlier studies, 
the present one avoids the assumption of any specific 
distribution for interarrival and service times. Ins- 
tead, the arrival and service processes are described by 
Meaisworegeneralsprobability functions. This makes the 
analysis general and it may be applied to any system 


that uses the same type of scheduling algorithm. 


As a particular illustration of application of the 
present analysis, the special case of exponential dis- 
tributions has been considered. Numerical results are 
given. They are based on the assumption of hypothetical 
values of various parameters such as quantum size, mean 
arrival rate, mean service rate, and the mean rate of 


interrupt servicing. 
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CHAPTER I 


INTRODUCTION 


In time-sharing computer systems a number of users 
are allowed to have simultaneous access to the system 
resources. This gives rise to simultaneous demands for 
computer service by many users and generally results in 
the formation of job queues. The queues are controlled 
by a scheduler which must react to the user requests with 
rapid response and, at the same time, maintain a suffi- 
Clently Nigh Operating, etriciency of the system. Typi- 
cally, a user's program will be executed for a small fixed 
period Of time called a “quantum” or “time-slice"™. Iit,will 
then be interrupted so that another user's program may be 
executed, and at some later time it will again be continued 


from the point where it was stopped. 


The users of a time-sharing system can be classified 
into two main categories: conversational or interactive users 
and production type users. The requests from the conversational 
users require less computing time for their completion and 
Hhoriauly have. Constraints On thei reresponse st ime ei necon— 
trast, the requests from the production type users require 
more computing time. The conversational users form a 
large proportion of the entire population of users and, 


hiMOnOStmLO Sautonymtiesce Users, tie requests from the 
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production type users are given lower priority and are run 
in the background. If this is not done, the response 

time for all the users will deteriorate to the extent 

that the advantages of time sharing will be defeated. 

Pyke [31] suggests that the response time for the conver- 
Ssational users should be less than the human reaction 

time and hence less than one tenth of a second. However, 
a response time of up to 5 seconds is likely to be accep- 


table in most practical instances. 


Thus time-sharing systems must be designed to meet 
certain response time requirements, at least for the 
users who require less than some fixed maximum amount of 
service. At the same time, the users with large service 
requirements must be served without an inordinate delay. 
These two requirements may be met in a satisfactory manner 


only if the system is not overloaded. 


Because of the need to meet the requirements out- 
lined above, time-sharing systems are very complex in 
nature and size, and their design presents a difficult 
problem? “Lt. is ,-therefore;*importaneetosknow thesgexpected 
performance of any system under various operating condi- 
tions before avdesign is implemented, SAgknowledgesorvthe 
behavior of a time-sharing system can be obtained by simu- 
lation, or by a mathematical analysis based on assumptions 


of the form of probability distributions of loads on the 
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System. The latter requires a study of the queveing 
problems and waiting times that occur in the various 
parts of the system. Another method of obtaining rele- 
vant information is by measurement of the activity in 
Vabvols parts Of an Operating system. But, this is 
useful only in performance evaluation of an existing 
configuration and can hardly be used to obtain informa- 
tion about the expected behavior of a ‘yet to be born' 


SYScem. 


The purpose of this study is to analyze the behavior 
of a time-sharing computer system from a mathematical point 
of view. Many papers have been published in recent years, 
and the queueing models therein seem to be most suitable for 
time-sharing system analyses. Response time, queue size, quantum 
size, length of busy period, etc., are some of the parameters 
SrLcen investigated. From the user"s point of view it is the 
response time that is likely to be the most important para- 
meter. Other parameters are useful for the system designer, 
because they provide an estimate about the utilization of 
Lie system Hesources. 

In one of the early papers, Coffman and Krishnamoorthi 
[12] presented an empirical investigation of an existing 
time-sharing system and a mathematical analysis of a queue- 
ing model which cGonsisted of a single server (CPU) and N 


customers (terminals) with a queueing discipline of round- 
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robin type. A similar model, but with somewhat different 
assumptions, was analyzed by Krishnamoorthi and Wood [24] 
and then by Adiri and Avi-itzhak [1]. Interarrival and 
service time distributions were assumed to be exponential 
in all these cases. Krishnamoorthi and Wood [24] obtained 
expressions for user congestion, system response time, and 
computer efficiency. They studied the effect of quantum 
size variation on these parameters; the overhead and swap 
timegwerefassumedstoybes zeroeesAdini andsAvicitzhaky | 1) 
assumed that the quantum time has two parts, namely a 
quantum swap time and a quantum processing time. They 
studied the effect of variation in quantum processing time 
on the system res amount of service 


onse time for a given 


requirement. 


Kleinrock [23] presented a mathematical analysis 
of time-sharing systems with the round-robin model and 
processor-shared model. He compared the results with those 
of a first-come-first-served model. Ina later paper 
Coffman and Kleinrock [10] analyzed, together with round- 
robin and processor-shared models, a multiple feedback 
model and a multiple feedback model with external priori- 
ties. ere ae were obtained for expected waiting 
times conditioned on the amount of service required. 
Waiting time in this case has equivalent meaning to res- 


ponse time. 
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Some of the other authors who have contributed to 
the mathematical analysis of time-sharing systems are: 


CianOaid) olpmccnerry (36],.Schrages (37,38), and; Shemers [39] « 


in all the earlier analyses the arrival and service time 
distributions have been assumed to be exponential, because 
such an assumption simplifies the mathematical analysis. 
Although the exponential arrival and service time distri- 
butions might well represent certain real situations, the 
validity of such assumptions could be questionable in many 
other cases. Krishnamoorthi and Wood [24] mention at the 
end of their paper: 

"This entire discussion has, however, been 
based on the assumption that both arrival and 
service time distributions are exponential. 

Before we could imply widespread real-world 
spol ueability Oofsoungresults, we-would have .to 
validate the assumptions) to a) greater) degree 


than we are currently able to do." 


In the present analysis, in order to make the results 
more generally applicable, the assumption of any specific 
distribution for arrival and service times has been avoided. 
Thus, LiesO1StrtbuLions are: aSsumedsondy ecOnbesgeacral pro] 
bobiliey euncCtions. | @hisc LOrms athesmain ii cercnce soeuyeen 


the present analysis and all earlier analyses. 
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With the above considerations in mind the aim of 
the present thesis is to investigate the extent to which 
a general theory may be formulated for analysis of time- 
sharing computer systems. The hypothetical model to be 
analyzed contains two queues which may be described as a 
foreground and a background queue. The reason for select- 
Wigs toemode lea cethateOrsitS Superiority to, the round 
robin type and also that it affords the simplest case of 
the multiple level feedback model. With some modifica- 
tions the present aioe could be used to treat the 
round robin model and possibly also the multiple level 


feedback model. 


Even for the idealized model considered, the general 
theoretical analysis becomes sufficiently complicated so 
that certain assumptions must be made. These will become 
apparent in Chapters III, IV and V. Although some of the 
assumptions are rather restrictive, it is believed that 
they are justified in order to allow development of the 
tieony we Lae Models snot wi ntendeds tos represent a lceal 
operating scheduling algorithm. It is hoped that the 
idealized model may still be useful in representing the 
major aspects of the real two queue system, and in paving 
thesway tor the antroduction Of Lunbhnem reLinemencs andy 


or extensions that may better represent the real system. 
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In this thesis a queue is said to have “control 
of the CPU" ahaa its tasks are being processed by 
the CPU. This terminology is not meant to imply that 
jobs have control of the CPU in any sense other than 
receiving service from it. Most of the previous analy- 
tical studies of time-sharing systems have adopted the 
terminology of queueing theory and hence refer to "server" 
misceddsOLectoeCPU, sand to “customers” or “units” instead 
Gin jJObDS GEwtasks., Itvis hoped that, no conrusion will be 
caused although it is realized that the terminology Ls 


in disagreement with that of queueing theory. 


The outline of the presentation in this thesis is 
ase follows:= 9 Chapter IIT is*devoted to a general descrip=- 
tion of time-sharing systems, and is intended to provide 
a general familiarity with them. The assumed mathematical 
model is described in Chapter III, and the analysis is 
Presented in Chapter IV and Chapter VV." In Chapter Vi, 
the analysis is applied to the system with exponential 
aeeival and service; the results are obtained subject to 
the assumption of some hypothetical values for various 
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GENERAL DESCRIPTION OF TIME-SHARING COMPUTER SYSTEMS 


Time sharing systems may be classified into the two 
broad categories of special purpose systems and general 
purpose systems [31]. The special purpose systems are also 
o£ two types. The first type is that in which the system 
PSeeectiEcledmuOnthe solution ©f a) single problemsor a 
Single set of problems. The users request execution of one 
Cielo ulacarvyecOouLI nes by meenseorea caliletor a function. 
An airlines reservation system is a typical example of this 
kind of system. In the second type of special purpose system 
the users are allowed to submit their own programs, but, 
these programs must be written in a particular language. 
This type of system is designed for the efficient execution 


of programs written in that specific language. 


The general purpose systems, on the other hand, do not 
contain as many such restrictions, and they give each user 
full access to the computer capabilities. The users of 
such a system may be regarded as a more or less random 
collection of people, each working on independent problems 
and using any of the several languages available in the 


system. 
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In general, the operation of a time sharing system 
is as follows: As user's programs arrive they are stored 
on magnetic drum where they wait for their turn to be 
executed. When a program's turn to be executed occurs, 
OMmgcuablysancadpotethis time, tteissbrought into main 
memory. If there is not enough space available in main 
memory, then some other program must be removed from main 
memory and restored on the drum; this process is referred 
to as "Swapping". The execution of a program terminates 
when it initiates input or output, when it refers to some 
other portion of the program not already in main memory, 
or when its pre-allotted time slice is used up. At the 


CeCULION, ENG DEOgranls Machine Glatuc 
is saved and another program is initiated for execution. 

The terminated program may remain in the main memory until 
hesmiccoCM LUG Oh CxXeCULLON,, Olle May. lDereslLOred Ol, the 
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drum. The complete process is controlled by the "supervisor' 


of the time sharing system. 


In the remainder of this Chapter some general fea- 
tures of various hardware and software components of time 
sharing systems will be described. The description is 
general in nature without being specific to any particular 
sveten itis eintended to providesthe reader with scone 


familiarity with time sharing systems. 
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2 lissnaraware: Features 


The hardware of a time-sharing system can be 
envisaged as a set of processing units, memories, and 
remote terminals, all interconnected by a network of 
communication channels. These units are usually required 
to have some additional features which are special to 
their use in time sharing operation of the computer sys- 


tem, and are described in the following sections [31,43]. 


Zee ee Cent ral eProcessingsUn Lt 


Since ce central processing unit (CPU) of a time- 
sharing system is required to provide satisfactory service 
to a large population of users on a centralized basis, it 
must be fast. Various features, such as small memory 
cycle time, more powerful instruction repertoire, highly 
parallel operation in arithmetic units, and a large number 
Of arithmetic and index registers, all contribute to the 
CPU speed and are desirable. Instructions such as Multiple 
Store and Load of CPU registers are useful in switching 
control from program to program easily since they provide 


fast. swapping and Loading Of the Instruction #couliver and 


arithmetic registers. 


In addition to high speed, the other features which 


Huesteberprovidedsan asCPU invorder Lo make it suitable for 
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a time-sharing system are "memory protection" and "memory 
relocation". Some of the memory relocation schemes require 
a considerable modification of the processor addressing 
techniques. Another important CPU feature is the provision 
of a powerful priority interrupt feature which, along with 
the specially designed interface, must provide an intimate 


Connects onmwuthmthes remote termanalslLonea realetime basis. 


Since the CPU of a time-sharing system must execute 
both the supervisory programs and the user PLrograms;eit is 
desirable to have two modes of operation for the processor. 
This prevents any user's program from harming the supervisor 
Or jeopardizing the operation of the whole system. The 
supervisory programs are run in master mode, and all input- 
output is controlled by the supervisor. The user programs 
are run in slave mode, and certain instructions such as 
HMiputymOuLDUL, andwhalteareniiwegqaia@in thistimoder tihis 
prevents any user from gaining exclusive control of an input- 
output device and disallowing its use by others. An input- 
OUucpuL Operationrun aeuse:  Saprogrameis achreveciby alcada 
to the supervisor, and in the case of a halt operation the 
supervisor simply changes the status of that program with 


respectutonthe scheduler, 


Zee Nem Memory 


Because) of ats multiprogramming»aspects, a time- 


sharing system invariably has a larger memory requirement 
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than does a similar non time-sharing system. A substan- 
tial portion of the main memory is required by the 
supervisor which must be resident in high speed memory 
at all times. This is essential since the supervisor, 
Pecponc tb lee Lonseverall monitoring and controlling of 
the operation of the system, is needed more often than 
any other program, and much time would be wasted if it 


were necessary to bring it into main memory every time. 


In order to meet the large memory requirements 
'efficiently, the memory of a time-sharing system consists 

of a hierarchy of storage devices which range from the 
fastest and smallest to the largest and slowest. The main 
memory, which is also referred to as primary memory, is 

the high speed random access magnetic core. The magnetic 
GnuM,awLlen SUELICTently large capacity and high data 
transfer rate, is used as an immediate backup for the main 
memory. The other storage devices, such as the magnetic 

disc and tapes, are used for large data and file storage 
ifecheesvstem. the CPU is only capable of directly, address-= 
inGmematmnanenory,eand » Lhesdatavsonedal Others clOragesdevices 
must be transferred to the main memory before it can be 


operated on by the central processing unit. 


The main memory of a time-sharing system is usually 
a set of random access core banks whose number varies from 


system to system depending upon their size. In large 
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systems the number of banks may be so large that a complex 
addressing mechanism in the central processor may be 
Bequrrea in order to access them. Each core bank in the 
system may be provided with a separate data channel and 

a complete addressing system so that all banks can operate 
Simultaneously. This makes it possible to overlap memory 
Operations of the processor and thereby reduce the effec- 
tive cycle time of the entire memory. In time-sharing 
systems where there are two or more processors operating 
in parallel this feature allows the simultaneous execution 
of a program from one bank and swapping of another bank 
with the backup memory. This helps to minimize system 


overhead due to Swapping. 


The backup memory is used as an extension of the 
main memory, and during time-shared operation the programs 
are swapped between main memory and the backup memory. 
There is a copy of each user's active program in the back- 
Upsmemory ,..and, only. the appropriate parts of a program 


are brought into the main memory before its execution. 


2b. oe Remote Terminals 


The user's access to a time-sharing system is 
obtained through remote terminals connected on line to 


the system. The most commonly used terminals in current 


time-sharing systems are type-writer-like devices which 
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Mayvebewelectricetype-writers with extra control features 
added. But, there are also terminals that use alpha- 


numeric display or graphical display devices. 
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In a multiaccess and/or multiprogramming time- 
Shaping, syslempsiteisy the responsi bid itveoteatkne 
supervisor, which is also referred to as the time- 


sharing executive, to control and allocate the 


system resources to various users of the system. The 


a3 


supervisor controls the complete mechanism of time-sharing, 


it makes all the decisions, and also ensures that they are 


CanprledsOute, Loacesolvesnihbescopis t.cisain Gemands for 


system resources, handles the interrupts, and monitors all 


the activity ingthe system. 


The responsibilities of a supervisor of a time- 
sharing system, as suggested by Ziegler [43], can be 


summarized as follows: 


(a) Control ofminpuseand Output) fons they, emote 


terminals: ayThis*tinchudesipolling offterminal 


limes purespondang atogterminaleorientedyre= 
quests, and also the delivery of output to 


the proper terminal. 
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Scheduling: This involves allocation of the 
CPU time to various user programs in the 
system according to some suitable scheduling 
Beyonce Reng ihe, sake: includes functions such 
as formation of queues, swapping of programs, 
and handling of all the interrupts whether 
due to software or hardware. 

wracemal OCalLlON sai tom heSpone. bi ia ty or athe 
Supervisor involves allocation of the neces— 
sary memory space for the programs being 
processed in the system. It also includes 
the allocation of other storage devices, and 
Control and iamplementatcvons or data relocation, 
swapping schemes, and memory protection 
mechanisms. 
Inpuk-Oulpulyprocessinguteinathissganreag the 
supervisor, controlssand anitiates. the input 
and output for the active user programs, and 
it) resolves, conflicts, by formingeat queue Zt 
some device is required by several programs 
at the same time. 

The last area of responsibility, referred to 
as “service operations", involves very varied 
functions. §—Lt includes accounting, plogging 
Of the System utilizacion, masntenance, of 


library program listings, debugging services, 
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handing, of specialwtypes of) input ori output, 


and a number of others. 


Detailed descriptions of the supervisors are readily 
aval dolewinethe literature [34,42,43]. In particular, 
the description by Wood [42] is quite comprehensive and 
systematic. A good discussion of task scheduling and 
resource allocation techniques as used in a medium size 
time-sharing system has been presented by Oppenheimer and 
Weizer [29]. In the following sections the CPU allocation 
and space allocation’ functions of the supervisor in a time- 


sharing system will be discussed in more detail. 
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ner uLocatronsoL ChUMtIMe=LObeVvartous suse: JObDS an 
the system is done by a system scheduler according to a 
SCusOuspLeS Decl ELead priority rules. vlhis set of rules, 
known as a scheduling algorithm, determines both the next 
job to be executed by the CPU and also its duration. The 
Main goal of scheduling algorithms in time-sharing systems 
UsmeGs provide ast response, tothe smalily incteracti vem soos. 
Normally, a newly arriving job joins a system of queues 
and, when selected 


Dyetiemscheauler, 


it is given one 


System of 
queues 


time slice or 


GueiveunOLeCPU 
Fig. 2.1: Feedback Queueing Process 
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time of amount gq seconds. If the job is completed within one 
CPU time slice then it leaves the system; otherwise it re- 
CUrnoecOsthessystem of queues “and waits for its next tumn. 
This is the general method of scheduling and is usually 
referred to as a "Feedback Queueing Process" [11,18]; it can 


be. schematically represented as shown in Fig. 2.1. 


Some scheduling algorithms are designed to maximize 
system operating efficiency by reducing overhead due to swap- 
ping and other supervisory functions. Others attempt to 
provide faster response to the users at the expense of the 
system efficiency. However, most of the scheduling algorithms 
recognize both of these goals to some extent and they attempt 
to provide a satisfactory response to the users while main- 
taining the system's operating efficiency at a reasonable 
level. There are many ways in which schedulers may select 
the jobs in the system for processing, but it has been shown 
by Schrage [38] that the best strategy is to first execute 
the jobs which have the shortest remaining processing time. 
Although a scheme somewhat similar to this has been used in 
CTSS [13], where processing times are estimated by the phy- 
sical size of the programs, the main problem is that there 
is no satisfactory way of knowing in advance what will be 
the processing times for the jobs. However, an alternative 
Psecolconsiderea joo S running timewin sOcrder tOsascilGnepraoLd— 
ties. This method is cere in most of the commonly used 
scheduling algorithms, some of which are examined here. A 
good disucssion of many scheduling algorithms has been pre- 


sented by Coffman and Kleinrock [11]. 
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The simplest 
of all scheduling 


algorithms is the 


Round Ropin (RR), in 

which all newly Elg=m2.2s  ROUNG RObDIn=Scnedulang 
Algorithm. 

arriving obs join cat 

the end of a single queue. The jobs from the queue are 

selecteawin aygtirst—come-first-served (FCFS) manner and 

G2chy road avon: one quantum of CPU Cime,Mq seconds: WFbE a 

job is completed within one quantum it leaves the system; 


otherwise it rejoins the end of the queue and waits for its 


iINe>Kic, Abpea 


The quantum size q may be fixed or it may be allowed 
to vary dynamically depending on the number of jobs in the 
system. By keeping gq small, the response time for the 
smaller jobs can be reduced but this, of course, implies 
an increase of waiting time for the larger jobs. A limit- 
ing case of gq > 0 represents the state when all jobs are 
pLocessed concurrently (at reduced rate) [10,23]. However, 
GH UomtomonlyeOrmericoretiCal sincerest, = ine Selection o1 
quantum size is a design problem, since if the quantum 
SrZeCmiISmCOOLSNall at TresuLts in) LOOsmMmuCch 2nCcreasemineoven— 
head due to swapping, thereby sharply reducing the system's 
operating efficiency. In the IBM CP./67 system [6], and 
in the GDC ARPA - system [40], a quantum size of 50 milli-— 


seconds is used. 
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ATCnougigas Ound-Lobin algorithm provides faster 
service to the smaller jobs, the main argument against 
its use is that the large jobs that have been in the 
system for long periods of time are given the same priority 


asvthe newly arriving short jobs. 


The Multilevel 
PeedbpackrA gorithm (FB.) 
is intended to overcome 


this drawback of the 


TOUNC- LOO LM algOmincum. 


In the FBy algoricnir, 


which is shown schema- 


Pigac. soup oCcneduling Algor? chm 


N 


GrIcalivaptivetld. t2.s 85a JOD ate tne Nead oLcpany given level or 
queue will not be processed unless all lower level queues 
are empty. Thus, immediately after a job has received pro- 
cessing the next job to be processed will be the one at the 
head of the lowest level of non-empty queue, and it will be 
given one guantum of CPU time. If more processing is needed 
then the job is subsequently placed at the end of the next 
higher level queue; otherwise it will leave the system. 

If N < » then the N-th level queue can either be serviced 


invasquantum controlled FECES manner Jor si nsrouncd—fobin manner. 


A combination of RR and FBy is the Foreground- 


Background Algorithm which contains two queues. The two 
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queues are referred to 
as foreground and back- 
round queu d 

g gq es, and all One 


newlyearea ving Obs 


join the foreground 

Fig.2.4: Foreground-Background 
queue. The jobs in Scheduling Algorithm 
the foreground queue are 
processed in round-robin manner until they have received a 
fixed number of quanta of CPU time. If a job is then not 
completed it is placed in the background queue. Jobs in 
the background queue are serviced only when there are no 


jobs in the foreground queue, and they can be serviced in 


a round-robin manner but with larger quantum size. 


Apart from the internal assignment of priorities by 
the scheduler, sometimes the priorities may also be assigned 
externally ...lhe assignment Of external priorities: may) be 
based on one or more of many possible factors such as 
estimated processing time, total memory requirement, type 
Gb input-output devices needed, and so on. For example, 
in SDC ARPA [40] an incoming job is placed in one of the 
three priority classes depending on the amount of core 
Memory required and whether or not it will use slow input- 
Outputdevices. “in another system in use at thesUniversicy 
OL CaliLornd anal Santalbarbaras LL) cher users siave to 
declare whether their program is interactive or LL SueOte 01O= 


ductLon type. 
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All the scheduling algorithms discussed: above.can 
be modified to take into consideration the externalils 
assigned priorities. In the RR algorithm the modification 
may be made by using different quantum sizes for different 
jobs depending upon their externally assigned priorities. 
In the case of the multilevel feedback algorithm the jobs 
with, different externally assigned priorities may be made 


to enter different level queues. 


Many variations of the above scheduling algorithms 
have been proposed. They generally attempt to minimize 
overhead due to swapping and hence to increase the operat- 
ing efficiency of the system. Mullery and Driscoll [28] 
have suggested an algorithm in which a job is allowed to 
use the processor until it is either completed or must be 
interrupted to assure the minimum response to all pending 
FObsuueea lL toOugis this algorithimebehavyes exactly like a 
round-robin when the system is fully loaded, or overloaded, 
the efficiency will be considerably improved when the 
system is underloaded. Another variation of the round- 
robin algorithm has been suggested by Coffman [9]; it 
attempts to improve performance of a fully loaded or over- 
loaded system by reducing the swapping. In, this algorithm 
one more quantum is allotted to the job in execution each 
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Analytical studies have been made of both operating 


and proposed schedulers in order to obtain estimates for 
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the queueing problems and waiting times in various parts 

of the system. Such analyses are important since the 
operation of the scheduler under various operating con- 
ditions determines the capacity arene system. Queueing 
theory [27,35,41], which itself depends on probability 
theory for much of its structure, has invariably been used 
for these analyses. Analytical studies of the round-robin 
algorithm have been made by Adiri and Avi-itzhak [1,2], 
Changu/ oj COLimManvand Krishnamoortha [12] Kieinrock 
[23], Krishnamoorthi and Wood [24], Scherr [36], Schrage 
[37], Shemer [39], and many others. Some of the parameters 
examined in these analyses are response time, queue size, 
meters has been studied. Similar mathematical analyses of 
multilevel feedback algorithms with priorities [6,10,30,39], 
anew. Choute pin orit Lresm: LOWS iipehave Dbeenycarniedmout. jAithe 
main goal of these analyses has been to determine the 
interaction between the system performance, the swap time, 


and the quantum size. 


A survey paper by Coffman and Kleinrock [11] des- 
cribes many scheduling algorithms, and discusses their 
effectiveness and their counter-measures. The analytical 
studies of scheduling algorithms have been surveyed by 


Hetrineand)»KLeinrvock, [1S], andvalso by Chang  [38]* 
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2.4 Memory Allocation 


Tngerme-sharing, systems the total amount of storage 
required by all active programs usually exceeds the phy- 
Sitcalysize of, the! core memory. “In order to make use of 
multiprogramming techniques for better utilization of 
System resources it iS important that many programs co- 
exist in memory at the same time. One method of memory 
allocation, which was used in earlier systems [13,40], is 
tovdivideyecach program into many, logically independent 
segments, and then swap these segments as required between 


main memory and the backup storage. 


This method of swanning segments gives rise to the 
problem that the movement of one program from main memory 
to backup storage may leave holes that may not be large 
enough to contain a complete program ready to be moved into 
the main memory from the backup storage. The supervisor 
must, therefore, allocate the main memory in such a way 
that holes are filled up in an optimal way. Associated 
with this problem is the effect on programs of being loaded 
into different memory locations after each swap with the 
backup EianaGem This necessitates that some form of re- 
location scheme be provided in the system. The most 
convenient scheme for relocation is one that ensures that 
there are no absolute addresses included in the main pro- 


gram, and the access to information is done through a base 
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register or some address-mapping device. Techniques for 
dealing with the relocation problem when absolute addresses 
are permitted are often very complex and have been discussed 


by McGee [26]. 


Memory spaging,. a concept which was first used in the 
ATLAS computer [22], provides a convenient means of handl- 
ing the memory management and relocation problem. A number 
of published papers [3-5, 15-17, 21, 25, 26] have dealt 
with the various aspects of paging and its effectiveness 
in time-sharing systems. A recent survey paper by Denning 
[16] provides a very comprehensive discussion on segmenta- 


tion and paging, their advantages, and their drawbacks. 


ieee aA LG 


Paging refers to the process of dividing up the 
memory into regular blocks which are referred to as pages. 
When space is needed in the main memory to bring in some 
DOhet@Oun@ ode pLOdLal, = Only. LNG number OLepagjes necescany 
are written out on the backup storage. These swapped 
pages may be brought in, when required, to any available 
page of the main memory. Sometimes a bit is associated 
with each page to indicate whether any change has been 
made in its contents since it was last copied from the 
backup storage. This knowledge can then be used to avoid 
swapping of any unchanged page since its good copy already 


exists on the backup storage. 
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Pages may be in sections ranging from a few hundred 
words to a few thousand words, depending on the average 
program size and the system hardware. In fact, one of the 
design problems in systems that use paged memory is the 
decision concerning the size of page. As pointed out by 
Randell and Kuehner [33], the choice of too small a page 
size will cause an unacceptable amount of overhead, whereas 
the choice of too large a page size causes space to be 
wasted whenever a full page is only partially utilized. 
Normally, in the systems that use paged memory, all the 
Dageseare. ob equal size. =in the Ferranti ATLAS system [22)7 
the page size was kept to 512 words, whereas in the IBM 
it is fixed at 4096 bytes. But there are 
several systems which, although still commonly referred 
to aS paging systems, have pages that are not of equal size. 


One example of such a system is MULTICS [14] which uses two 


page sizes of 1024 and 64 words. 


The use of paged memory also involves the translation 
of virtual memory addresses, as used in a user's program, 
into the actual physical addresses of core memory. This 
Cranslatron,. Ob Mapping, 1s) the=responsi bility .Olmeche 
System, and ic iS accomplished ¢1 ther entirelysby shardware 
Or wilthiethe essistance of the; supervisor. ihe users 
virtual memory may thus be scattered in small parts through- 
Gut the physical memory, Dut Ne uses*it aS if it were in 


Continuous locations. 
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In some systems [14,19], another level of address- 
ing is introduced in order to accomplish a more elegant 
mapping from virtual to physical memory. This involves 
dividing up each program into logically independent seg- 
ments each of which may consist of several pages... Such 
segmentation of each program minimizes the amount of main 
memory requirement at any time. For each user program 
there then exists a segment table and a page table in 
memory. The memory address as specified by the user in 
his program has two parts consisting Of a high level part 
and a low level part. The low level part becomes the low 
level part of the physical address. The high level part 
specifies the segment name and the logical page address. 
The segment name is the relative position in the user's 
segment table which provides the base address for the page 
table. The logical page address is the relative position 
in the corresponding page table that contains the high level 


part of the physical address. 


2.4.2 Page Management 


An area of responsibility introduced by paging is 
movement of the required pages in and out of the main 
memory. Denning. [15] refers,to this function as “paging-in= 
and "“paging-out". Demand paging has been used almost ex- 
Clusively mLtCelespaging ane whachenOmactlone ts taken to load 


a page into memory until some program needs to refer to it. 
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There have been some proposals [32] for loading of pages 
beforehand. However, it is not very practical to obtain 
reliable prior knowledge of the pages which a program will 
needeingthe! futuret murine etfalv[ 20] haveedone some research 
on an attempt to determine if any pattern exists in the 


endeneofepagessthatea programtwill requires 


In page management it is not so much of a problem 
to determine which page to move into core memory as to 
decide which page to move. out in order to make room for 
a new page. If the page removed is immediately requested 
again then it has been the worst possible selection. The 
best choice is to remove the page which has least likeli- 
hood of being used in the immediate future. A good decision 
about the selection of the page to be removed is very impor- 
tant since it may have a significant effect on the page 
trakiics (the numbeneofipages per sunitcof timenbeingrmoved 
between memories [15]) and hence, on the performance of the 
system. Some of the suggested strategies for page removal 
ares) random selection; £irst-in-first—-out (FIFO) selection: 
and least recently used (LRU) selection. In random selection, 
whenever a page is needed in main memory the page to be 
replaced is selected at random. This meta has the ad- 
VancagesOL simplicity an amplementaulon, sout at the same 


Linewntehasethe GCrawoack that it frequently removes useful 


pages. 
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In the FIFO method, the page selected for replace- 
ment is the one which has least recently been paged-in. 
This method is based on the assumption that the memory 
references in the immediate fuchreprdia be close to present 
ones, and so the page which has been in the memory for the 
longest time is least likely to be used again. However, 
such an assumption is questionable, and Fine et al [20] 
have experimental evidence to show that references are 


scattered over a large number of pages. 


In the least recently used (LRU) method of selection, 
GacuepacCemudo les contains an USen Diss WitCchmismsoet readchecime 
the page is referenced. At regular intervals all pages 
are examined and their uses updated. When a page is to 
be paged-out, the one unreferenced for the longest time 
is selected. This method, although it appears to be most 
reasonable, may sometimes cause overloading when many pro- 


grams compete for main memory. 


Many studies concerning the behavior of various pag- 
ing algorithms have been published. The importance of.the 
page replacement algorithms becomes evident when one con- 
siders how the paging increases with the increase in 
number of user jobs in memory. Belady [4], has made 
mathematical comparisons of some of the paging algorithms, 


and he. concludes that an “ideal” algorithm should have the 
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Simplicity of Random or FIFO and it should poses some 
accumulation of data on past references. McCredie [25] 
has studied some measurement criteria for paging rules 


which might help in selecting the proper algorithm. 
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CHAPTER eli. 
DESCRIPTION OF THE MODEL, AND NOMENCLATURE 


3.1 } Assumed =Moded 


The assumed model contains two priority levels of 
Tequeste fOr servicetas Shownyin Fag. 3.1.) The queue 
that contains the highest priority requests is designated 
as Qyi the queue that contains the lowest priority requests 


is Q.- 


The requests from outside the system enter to be- 
come tasks in Qi: Each task in Qy is given control of the 
CPUBrOG a) Timersilice” of duration Aw )lio the request as 
completed in time less than or equal to A the task then 


leaves the system as indicated by "OUT"in Fig. 3.1. 


Alternatively, if the request requires either paging 
SLernpuc=-OuUEDUL Service while Gt 1s in control of the Cru 
Elche teers intel rupted@tO=lOSee control Om the CPUS A 
request is also interrupted if; safter having a° control of 
the CPuStfor full time slicevsA, it 1s yet not completed: 

In either event it enters the "interrupt server" to receive 
the required interrupt service.” "On" completion on gUS sinters 
Upee service, the request iS™againrplaced at™= the end of Q,- 
However, if a request in Qy NdswhaceCONcLOL OL tice ce Umer Ol 

a total accumulated time Aye and has not reached completion 


GuabEemOLOceSoing ,sthen at aS placed at. the end of Q5- 
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Serves 


Prg.no. ls) MOdeHe wiln= LWOe priori CyMLevelseor 
requests for service. 


If at any time Qy Contains no task) then control som 
CheveCeurnis* Given to ae ctask= in Q5 for a time’ slice A. Lf 
the task is completed during the time interval A, then it 
leaves the system. If the task requires paging or I/O 
service during the time Aor omit has! usedvups theatuaill 
time slice A. ancsis™vyet not completed, Pthentiweas guter— 
Luptedvandeenters Hhewinterrupteservery “LoOmreceivemthe 


fequired service., Oh Completion onethis®serwicesthke task 
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is placed at the end of Q Where It Waits its turn for 


mUuricher CeuU time. 


On completion of processing a task in Qo the queue 
oT is again examined and, if it is not empty the control 
O eciicwery Gis oc von@ceeit. Alternatively, 1f there is no 
task in Qu, the control will be given back to Q, ie soe 


does contain more tasks. 


Whenever the CPU becomes idle, because there are 
no tasks in O71 or Q, te™assume™control of MEhne@®CPU, Tit 
femains 1dle“for a= full’ pervod* Ae “At°the end ofsuch an 
idle period the queue Q1 is examined and control may be 
Giuven=ctora task that has arrived in Q1 during the idle 


state. 


invchvs=model anw@arrival offawtask® ain thevhagher 
priority queue O71 does not cause preemption of a lower 
priority task already being processed, although such 


preemption does occur in some real operating systems. 


Tt is assumed that no CPU time is spent in paging, 
examining the queues, switching control from one program 
tovanother, or processing input-output requestsier This 
is anidealization of the real physical™ process where 
Overhead due to all these functions is never zero; but, 
Giiseessuiperon ise pbeang made inorder tO simplify the 
eualysie, Further, 1t is also assumed that the total 


memory size and the swapping algorithm used are such that 
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Urewicetul pages of the tasks, waiting for processing in 
the two queues, are not swapped out while they are in the 
queues. This may be ensured by a suitable swapping 
algorithm which is possible only if sufficiently large 


main memory is available. 


Interrupt Servers 


Within any queue, a task that releases the CPU 
before it has received its maximum time allotment for 
that queue, and which will require further CPU time, 


enters the interrupt server for that queue. 


If the task does not require interrupt service it 
immediately leaves the interrupt server and joins the 
end O& UESEQuCcUC wb GasGhen, waits .1ts pburn stor pluntner 


CPU time. 


fet z denotes the total time that a task spends 
in an interrupt server. This time may include waiting 
timercequized until a particular device, such as an @/0 
channel, becomes available. Let g(z) be the probability 
deneity ob 2.) Thevrunction) g(Z)ewi ll) be usecase lacverain 


the formula tor calculation of response time? 
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Nomenclature 


Payee) 


i$ 


Aj, (nit)> 


Aj (nit) = 


A, (nj t) = 


q, (n7t) = 


Probab ity thateduring atimesinterval t 
there are n tasks input to O71 from outside 
the system. 

Probability that n tasks enter Q1 from the 
interrupt server during a time interval t 
while Q, ias) CONLLOL@OL tic CPUS Theyinter— 
val t begins at the instant when Qy receives 
COomim70 ROL etnesCPU. 

Probability nee n tasks enter Qy from the 
interrupt “server during a time interval €t 
while Qy does not have controly of the CPu-; 
The interval t begins at the instant when 
QO releases control of the CPU. 
Prolab mia eymtiatean lOta le OranmeLasks enter 
Q, during a time interval t while Q1 has 
COoUuero leone CheeCPUls the, intervalet, begins 
at the instant when O71 receives control of 
Enes CRUE 

Probabid tcymthiatwas COLalMOLe Nn) tasks. enter 
Q7 during a time interval t while Qy does 
NnGtenave Concro WOLetniesC PUL Se hemiiitervad 
t begins at the instant when Qy releases 
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Probavulity Sthat tduringwa tuime intexvalit 
therefare inW@tasks@thateare input Lto Q, Jalst 
after receiving a total accumulated CPU time 
Ay through Q)- The interval t begins at the 
instant when Q1 receives control of the CPU. 
Probal il vey titat tdtimingta atime interval ve 
there sare nrtasks@inpuveto Q, from the 
interrupt server. 

Probab liktsy Sden siiny conetiiel rime sie ( SFA ior 
which a task in 7 retains continuous con- 
Cio l@or tile CPUS 

Probability density of the time ts Cs Ay) 
COtawitch wagtask sin Q5 retains continuous 
GOUCLO LeOl eCiewC PU 

Probability that while Q, Bas Control on the 
GPULFOrecImest Lt will process exactly m 
tasks. 


Probab litvyodensitysoLetne times. tlaued 


user request spends in the interrupt server. 


= Probability that there are n tasks in Q, 


ab the time when Q1 releases control of the 
CGeUr 

Brobabililtyethat there 1s ate leasteones cask 
ad: Q> to take over control. of the CPU when 


Q) releases it. 
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Average waiting time for tasks in QV: where 
waiting time is defined as the elapsed time 
between the instantwor arrival of a task in 
Q1 and the instant at which it receives con- 
GeO leoteche CPU. 

Average waiting time for a job to receive 
DeSetitsia CPU, timers laceun Q,- 

Average waiting time for a job to receive 
its second and subsequent CPU time slices 
in Q5- 

Probability density of the response time 


th fOcCea Lack, thaterequi ress CS ectOovalspLO- 


cessing time a Ca in n time slices. 


=) 
Expected response time for a task that 
requires its total processing time TS Kes 
in n time slices. 

Probability density of the completion time 
te. for a task in Q, that requires its 


. : t . e 
remaining processing time Ts Lelie 


slices. 


Ss sexpected completion) timesin Q, for a task 


that requires its remaining processing time 
m Loe Camens.ULCcase 

Expected, total srésponse vine" EOrlagtasiethat 
equi resid sLOcaepLOcessi ng muLine TS: For 
e,(T,) is the same as E(To 7), Due 
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hlimemsiacev sor quantum ror the tasks an Q7 
and idle period. 

Total maximum accumulated CPU time that any 
job can receive through Q- 
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CHAPTER IV 


ANALYSIS OF Qy 


Ave INDUCeDUS tr bUELOn Punct i onsaror Q) 


Mestaskseanput to Q7 include those that enter 
from outside the system and those that enter from the 
interrupt server for Q,- The probabil tty Gist mtpution 
of tasks that enter from outside the system may be des- 


Cribedsbyseamaftunction A, (nit) where 


A, (n;t) =e Probability ethac duringmartime sintervaL 
t there are n tasks input to Qs from 


outside the system. 


The rate at which tasks enter Q, from the interrupt 
server depends On EReeetates OlecOntuLo LOL ELNe CPeUCaE ion 
example, while Q Tomiie COUCTOIMOteCheneCPUstCNCLeg cea 
steady flow of tasks to the interrupt server; some of these 
tasks may require no interrupt service and hence may return 
immediately to Q,- However, when Q, nGch jelehe aMrkvelegievceyl, (ere 


thes CeU there is noeflow of taskseinto the; interrvupe csenver. 


Consider a time interval t that begins at an instant 


t, when Q assumes control of the CPU, and suppose there is 


id 
then a high rate of flow of jobs from Q,- As t increases, 


the rate at which tasks leave the interrupt server also 
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increases and may reach a steady state as shown in Fig. 2. 
However, after Qa releases control of the CPU at time te 
there will obviously'be a decrease fin the rate at which 
jobs leave the interrupt’ server. 
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Fig. 2: Rate at which jobs leave the interrupt server 


In the present analysis it is not assumed that 
theresis agnigh rate of, flowsof jobs from Qu, and notes 
assumed that a steady rate of flow is reached while Q, 
hasmconcrol otvthe CPU. However, it is assumed that the 
Statist Ccalvy distribution Cf jobs anput to Qa is dependent 
on whether Q1 LS OL Lo eNOG, eLieCONL LOL Of ClOm CLO mmm ies 


CvOmDoOCabDL it yed1ScribuLiOnSeares detaneduds e£0s_OWs. 


Aj, (n;t) =sProbdbi LECVathatenetaskomenuers Q) from 
the interrupt server during a time 


interval, t whaue Qy hasecontrol oLacne 
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Aa ne) = Probability that n tasks enter Q1 from 


the interrupt server during a time 


interval twwhile Q, does not have con- 


tro leon thes Ceu-. 


Tnes tocaleinput of tasks to Q, Guring varcime et 


while Q) has control of the CPU is described by the pro- 


babilrey-distribution: 
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Een) ao) lula) wa @enae) (Alt) 


m=0 


DiSeEoLOUtLOn OL lasksuin Q, 
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defined as follows: 


h, (t,) = Probability density of 
iene \ieaWeln Gy Veekeyi<” age) Qa 


CONtrOleCohaciew eeu 


h, (t,) = Probability density of 
£OLwhlchrastac mia: Q5 


CONULOU, OL ethe gobi. 


When Q5 receives control of the 
for a time whose average value is 
t.) she 
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aketek (van Gead bk tere. 
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the “time t. (<A) 
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retains continuous 


the time ty (s A.) 


retains continuous 
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ais control Or tne CPUF 1s -returned= to Q7 after Q5 


NaaeadecOnterol for a timer: the probability that there 


2 t 


are n tasks in Q, is given by 


q, (nity) = A, (nj, it.) Ajo (n-ny it.) ; (AB) 


ar M13 


A@weeeAVeLage Time ofr Continuous Control of the CPu by Q) 


SUDpOSe = that during control or the CPU by Q, there 
ares tasks processed in time st. Suppose, further, that 
Qy contained n tasks at the instant at which it assumed 
COonceo eLrom Q5- Then m-n tasks must have been input to 


OyeCuUri nga the cime st. 


os 


Now, if Q, receives control of the CPU after Q. has 
had control, the probability that Q then contains n tasks 
is 

5) 

J ti lueey Gu imine) che 2 


DUGAN eas lube, time t of continuous control by Q, some 
tasks may enter the system from outside, and some may 
enter Qy after receiving interrupt service. Thus; the 
following expression represents the probability that 
dUGmngecio CIM LeaLnere alee meacasks available in Q) ele) 


assume control of the CPU: 
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It may be remarked that m does not represent the 
total number of different jobs processed through Q, since 
some jobs may receive several slices of CPU time during 
Gheeuile steandshence contribute several Units tom: — In 
fact a "task" is used with the understanding that it sig- 
nifies one request for CPU control and hence may be a 


portion of a complete job. 


The above expression refers to the number of tasks 
that are ready -to assume control Ofte UneCsCPURCUrINGs tamemts 
MescOntainssnowallowance for thevability of the CPUlto 
process the tasks. Such allowance may be incorporated 
PiECuC haat rOduct won Of a -LuncGtion S, (m;t) defined as 


follows: 


S, (m;t) = Probability that while Qy has control 
Ot tie *CPUSEOomUINCm 1 Uawi lip rocess 


exactly m tasks. 


Now if Q1 receives control of the CPU and releases 
Resa buer processing Muatasks inetime Le then cxacely om 
tasks must have been available in Qy iS llemt <A sO 
the CPU must have been able to process m tasks in time t. 
Thus, the following expression represents the probability 


that when Q7 releases control of the CPU it has processed 
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Summation with respect to m gives the probability density 
Pp, (t) of the time t for which Q) has continuous control 
OrecouceCeU. se Thus 


A 
Dy) ie) Sus J S,(m,t) hy (ty) gq, (nit) A, (m-n;t) dt, , 


(4.4) 
where k is a normalizing factor chosen so that 


foe) 


J oy, Ce) le Sr a 
0 


The. average duration of continuous control of the 


CEURby Qy after Q5 Has) had Lesecontrol,. 1s 


co 


nS J taphet)) dt. (4.5) 


SUDS La tution, LOL p, (t) leads to 


1 see Sein) OG in er (4.6) 
geal 
where 
Ay 
y(n) = J qy(nit,) hp(t,) dt, 
=» Probability, Ghat Qy contains n tasks 
when it receives control of the CPU 
from Qos 
and 
t(n) = ae S t S, (m+n; t) A, (m;t) dt ; (re?) 
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Seaverage time required by the CPU) to empty 
Qu Powon receiving control Q1 contains 


nNecasks. 


THeSnOLMa Uzing actor skemay .be expressed in the 


form 


i Say ING) ay (4.8) 
n=1 
where 
foe) eo min, t\eAy (me edt (4.9) 
m=l1 0 


= Probability that the CPU can empty Que 
if on receiving control Q, contains n 


Caskse 


The above analysis applies in the instance 
that Q,. receives control of the CPU from Q.- However, if 
at the previous release of the CPU by Q) there was no task 
in Q5 ay, to assume control then the CPU would have 
entered the idle state, and it would have remained in the 
ToULewS tate mGOLCraetime A.) Thus, 2k Qy then received control 
OfBchesGPULLt, would now receive 1 diGectlLy trom Q. but Lrom 


thes idle state or curation A ss ouch sane estancestomaiaby2ca 


below. 


When Qy receives control of the CPU after it has 


Deenmicgle forsausingle tame slice A, the probability density 
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Elatetteretaime control continuously for a time t is given 
by the following expression which is analogous to that for 
P(t); 

©o m 


ey (HEN ee OY Sa (Gipie) Ge ine) he Crease A ( ) 
A ty oS il 1 i 


where Ky Lopa normalizing tactorechosen so that 
co 


J jE) eke eal 
0 


‘and hence 


el / = ery (ne) knee (Oe id) 


The average duration of continuous control of the 
GPULbYy Q) after the CPU has been idle for a time slice A 


is, therefore, 


foe) 


= 1 i 1 CE) CHE 


KH 
| 


ky , q,(n;4) t(n) . (Am) 
n=1 


Now let a probability ro be defined as follows: 


ro = Probability that when Qy releases control of 


the CPU there is at least one task in Q5 


ready to assume control. 
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The probability density of the time t of continuous control 


O£ the CPU by Q, Tere n is 


pb) = roP, (t) + (1-r.) Pp, (t) (475 13.) 


and the average duration of continuous control of the CPU 
by Qy is 


foe) 


TD) taiX5 S t p, (t) dt + (1-r,) S Eep, (t) dt - (4.14) 


4.3 Average Length of oF 


At the time a task arrives in Q, the CPU may be 
either in the idle state, under control of Qo: or under 
control or Q,- At any instant chosen at random the pro- 


bability of the CPU being in the idle state is 


or eta + roT. + (1-r,)A] 2 


The similar probability of the CPU being under control of 
Q5 7S 
roto/(T, + rT. + (1-r,)A] 
aidmecie sprobabdsli Ly ot sits beingeunder contro leoe Qy is 
T,/(T, + rot, + (1-r5) A] 


The three possible states of the CPU at any instance 


may be examined as below in order to determine the number 
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of tasks ahead of one that arrives at any random instant. 
Case (i) 

Suppose a task arrives in Q) when the CPU has been 
Zdle.for time t* (<)A)*. The following expression gives the 
probability that there are n tasks ahead of it in Q)- 


nh 
a (ape) Sl) Aas) Dale RE) 6 (4.15) 
n,=0 


If we assumeuniform probability of arrival of this task within 
the idle period of length A then the probability of there 
being n tasks ahead of any task that arrives during an idle 


state is 


A n i] il 

See LZ AVR Ge mer nae CAS (noting bed t 
0 n,=0 

iL 


A 
(1/A) fq, (nit) dt. (4.16) 
0 


Case (11) 


Suppose a task arrives in Q) when Q. has had control 
OfmthesCPUBTore time tiat(s A). The above expression for 
£; (n;t) gives the probability that there are n tasks ahead 
Ole iian Q,- Suppose the length of continuous control by 
Q. de t..  [f@there is uniform! probability, of arrival of this 


Z 
task during the time t. the probability Of there being n 
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tasks ahead of any task that arrives in Q, during the 


time to 1s 


Nn 
i] 1] 
Dey VAG (OG Pane (nensh t) fat 


Css , 
n~= 
i 


Bucy the probability density of t. is hy (t5). 


Therefore, the probability of there being n tasks’ ahead 


Ofmanv. task tthateanrcives tin Q) during= Conicoi of ctiemeru 


by Q5 is 
ny 5) n P 
f.(n) = S In Cet plat = (Pee ee #AL (noe mane s(n te dt 
0 n,=0 
Ay ey 
= J [h, (t,)/t,] dt, S q, (nit)! dt .. (Alas) 


Case (iii) 


Now consider the case that a task arrives in Qy 
while Q5 Nasmcoutrol of the sCPUCe Nao ecControOlepy Q, may 
have been preceded by control of the CPU by Qi alterna- 
Givelyelt say lave joeen) precededsby tan 10d leustaccem mine 
probability of the two alternatives are ro and 1-r,. We 


examine these two cases separately: 


Bicst (consider thatetineacentroly OneChUMby, Qa was 
preceded by control by Q5- In this case, the probability 


of there being n tasks ahead of any task that arrives in 
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Q, when Q5 hase Nad scontianuouses COnETOlm.Of st heMchUstorma 


Cimeret 1s 


nen, A 
an Lye, OF S < 
Ro ee peer he Ari yen ainy, t]he Cy) deer 
n,=1 nj =1 0 


(4.18) 


Let us suppose that the duration of continuous con- 
eC ep Orecicy CPUR by Qy is t,- But, the” probability density 
Sui, ty is py (t). Hence the following expression is the | 
probability that there are n tasks ahead of any task that 
arrives in Q, duvang= SUCIy aspeE1OG Of sCOnuinucusscontLols OL 
the CPU by Q,: 


2 


1 
2b 


Eo aU = S [p, (t,)/t,] dt, J 25 GRWAEIE RB. (4.19) 


Now, consider the case that the present control of 
the CPU was preceded by an idle state. The probability 
of there being n tasks ahead of a task that arrives in Qy 


when Qy hase iad sa CONntAnuUOUSHCONLYOIlwOn eheseGhPUstolean lime 


Bi abe 
% ntn, 
TART at) a) Yq, (ngrA) S$, (nyit) A, (ntny-nyit). (4.20) 
n=l nj=1 


Since in this case the probability density of the 
duration Of continuous control of the CPU by Q) is Pa (ty). 


the probability of there being n tasks ahead of any task 
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that errives in Q, during such a period of CPU control by 
Q,, is 


“a u 


£,(n) = S [p, (€,)/t,] ole J f, (nit) dt. (Amos 


Combining the above two cases we obtain the probabi- 
My Of there’ beangen taskseahead offany) taskthatuiarrives 
in Q, JULiNnGeaepethLOd OL CONtroOlmors thes Cru Dy. Q,- This 


probability, Ls: 
{ Wt 
£, (n)=r5f, (n) + (1-r,)f, (n) 
_ ¥(ng)Ay (ny Ft)Ay (nny ny ;t) at 
nin, 
Tseng beso Saleen ae aes hice ee 


fi meme 
CASS 


The expressions for £,(n); £(n), and £, (n) derived 
above can be used to determine the average length of, or 
number of jobs present in, Qi- The probability of there 


being n tasks in Qy at any instant is: 


(l-r )A£; (n) -+ roT5f, (n) + T,£, () 


2 (4, 335 


Es(ri)ee= 


Wes Soe fea 


1 oT 5 “+ (l-r5)A 


The average length of QQ is, therefore, 
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Ney =) cae tage (4.24) 


4.4 Average Waiting Time 


Waiting time may be defined as the elapsed time 
between the anstame. at arrival off a task in a: queue and 


the instant at which at receives control of the CPU. 


Liiva task arrives in Q, when the CPU has been 


idle for time t its average waiting time will be: 


eee ae ee aT) 
where 
bes ="Average duration of "continuous control “of 


BhCverUNDYy any task in Q,- 


For a task that arrives in Q, at any anstant suming 


an idle state the average waiting time is 


A co . 
w, = (1/A) } PiGivetent ne 7h he my the ale) ake 
A foe) 
= (A/2) + (A,/4) J adie n eerie india s (4.25) 


For a task that arrives in Qy during ecOnturol onmEne 
CPU by Q5 Oimaura tion t. the average waiting time is 
2 fore) 
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Now the probability density of t. is h, (t,) over 


Giese ranges) e<at7")<. A Hence, tOuea taskathatearrivesuin 


2 ou 
Q while the CPU is controlled by Q, the average waiting 


time is 
AS ome 
Wo = J [is / 2a (Ae) J ado Nes (or tjyedti ah (i) edt 


(4.26) 


POGsaetask tilat arrivesein Q) Geybhaskiels) (eleygeieeyl Gis aS 


CPU by Qy the average waiting time is 


(ee) 


Wo er(hn/ 2)yaere AS ye nSii(n) (4.27) 
n=0 
It follows that for all tasks that enter Q, the 


average waiting time is 


DW ae | Wee Eee (Te) We 
Ww. = pl ee lg. 2 See es eae! ; (4.28) 


val a 
T) + rot, tad. ro)A 


eee RCSPONSc lame 
Response time may be defined as the total elapsed 
time that a user job spends in the system from arrival to 


its completion. 


Suppose «that: aijob requines astotal CPUstime T, 
(< Ay) in n slices of lengths Tyr Tor seer Ty (SA) Ffand 
also interrupt service times of lengths Zyr Zor seen 2 


n-l 


such as paging times. 


a 
A ”, 


a> 9 
Pitted side orl 


a 


If n= 1, the average response time for the job 
is 


W (4.29) 


1 a Ty - 
If n = 2, the average response time is 


(W, + T,) + Z. + (W, + 15) = Oy Ue 


dh i i> 


Since g(z) is the probability density of the length 
of interrupt service z, the probability density of the 
response time us for all jobs that require two CPU time 


slices for their completion is 


yo(t,) = g(t, > 2W, - T,) . 
By using the relation 


ett = Gye) TP elo bea enee) shy (4.30) 


—0O 


where Giw) is the Fourier Transform of g(z), the above 
equation can be written as 
ep ees) tee 19am) JxG(w), expbiw (i, seetWicae te) lied e 


—o0o 


(4.31) 


Tf n = 3, so that the task requires three CPU time 


slices and two interrupt services, the probability of res- 


ponse time is given by 
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Y 3 ( =~) J g (Zz) g(t, 3W) ie z1) dz, - 
Using the convolution theorem for the Fourier Transforms 


we can write the above expression as follows: 


via tibia BO Amine his ata) exp[iw(t_- 3W 


—Co 


is Ts) ] dw 


(475°32)) 


Similarly, if a task requires n CPU time slices and 
n-l interrupt services, the probability density of its 


response time is given by 


(oe) 


Vente eel 2m) i ee cea exp [iw (t_- nW 


—0O 


17 To)] dw 


(4.33) 
The expected response time for such tasks is, there- 


fore 


(oe) 


1 (tly ad } ted Se lib teh eas 


= || eee. (EES Mele VS (4.34) 
nW,+T. aed ee - 


Given the value of Tor n can be estimated for a ty- 


pical job in the system by using the relation 


(n-1) i < T. anil AY ; (A= 35a) 


and for a compute bound job by the relation 


(nS) Aes Ts < Aw ws (4.35b) 


By a compute bound job as referred to above is 
meant a job which retains control of the CPU for a full 
time slice A. The relation (4.34) deduced above provides 
an expression of the expected response time for a job 


contingent upon the length of its CPU time requirement. 


In the foregoing analysis the functions Aj, (nit) 
and Ajo (nit), which describe the input to the queue Q) 
from the interrupt server, have been assumed to be inde- 
pendent of A, (nit) and h, (t,). This assumption may make 
the model less accurate, but was necessary in order to 
Carry on the analysis. However, in the case of large 
variances on the values of duration of continuous CPU 


control by a task, and the interrupt service times, this 


assumption is not very unreasonable. A similar assumption 


that the function A, (n;t) which describes the input to the 


sy 


queue Q5 from the interrupt server is independent of A, (n;t) 


and h, (t,) has been made for the analysis of Q,- 


In this chapter, formulae have been obtained to 
permit calculation of the average number of jobs in Qu: 
the! average waiting time, and the expectedwxresponse) time, 
in terms of certain probabilities that describe the 
system conditions. This completes the analysis of Qi: 


A similar analysis of Q, will be presented in the next 


chapter. 
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CHAPTER V 
ANALYSIS OF Q5 


Sales Input Distribution” Functions for Q. 


ThestackSeInpiUte co Q. include those that enter 
Gireccely f£Orethe first time arter=receivingsa total 
processing time Ay while being in Q, and those that 
enter from the interrupt server. The probability dis- 
tribution of the arrival of the tasks in Q5 from these 
two sources can be described by functions A, (n;t) and 


A, (n;t) where 


A, (n;t) = Probability that during a time interval 
t there are n tasks input to Q5 that 
enter just after receiving a total | 
accumulated CPU time Ay through Qy- 

A, (n;t) = Probability schac dubbing mat ime, Interval 


t there are n tasks input to Q. from the 


interrupt server. 


beens *apparent that the chances Of sa Tequesiteconplsu. 
iigmitesetOtcal amounteot .CPUstaime A, at some particular 
instant and also requiring interrupt service at the same 
instant are negligible. Hence aa tecan sbesascumedgthateala 
the tasks which have received a total Serene fea CPU time 


A, and are not yet completed, will enter Q, directly. 
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Further, this also implies that such tasks enter Q.5 only 
during the period when Q1 has-contsol tof wtihe: CPUR CUihust, 
during a period when Q7 does not have ‘control fof theicPu, 
there "are io-tasks- tinputt*to Q5 from this source, and hence 


the function A. (n;t) woe sGhen ZeKnouncr talus meceL0). 


2 


Peeuine cron q, (n) to be used in subsequent sections 


is defined as follows: 


Qo (n) = Probability that there are n tasks in Q. 
at the time when Qy releases control of 


Coe CEU. 


eee VeL age uengEn or Q5 


At the time when a task arrives in Qor the CPU may 
be either in idle state, under control of Qo: or under 
control of Q- At any instant chosen at random, the pro- 
Dbability of the “CPU “being in these three states is 
efi Vdeie Vole (OE r,)A/([T,+ rot, + (1 - ro)Al, 
roTo/(T,+ roT, + (l - r,)A] and T,/(T,+ roT. + (1 - ro)Al, 
respectively. 

In order to determine the number of tasks ahead of 


one that arrives in Qos the three possible states of the 


CPU at a particular instant may be examined as follows: 
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Case (i) 


Suppose that a task arrives in Q5 when the CPU has 
beeneinetale: state for time t (<A). Then A, (n;t) repre- 
sents the probability that there are n tasks ahead of this 
newlysarrived task. If it is assumed,_that there is a 
uniform probability of arrival of a task within the idle 
period of length A, the probability of there being n tasks 
ahead of any task that arrives in Q., during an idle state 


Of thesGPu is 


A u 
v; (n) = (VAs) fe, dea. (Seal) 


Now consider the case that a task arrives in Q., at 
the time when Q5 hasmnad | controleoL sche: CeUPcpOreascontinuous 
timest (< Ao). The probability of there being n tasks ahead 


Opechismtask in Qos is 


The r 
d q,(m) A, (n-m+1;t) 
m=1 
Suppose that the length of continuous CPU control 
by Q, is t, and that there" is a uniform@probability of arri- 


val of aygiven task during t,. Then the probability of there 


being n tasksahead of any task that arrives in Q, during the 


period to is 
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A> ene : 
Vo (n) = J [h, (t,)/t,] dt. J a Qj (m) A,(n-m+l;t) dt . 


(52) 


Case (iii) 


Now suppose that a task arrives in Q. during the 
period when Q) iss “alfel fefe}owohate ul, Vohe “elute YOIDU,” “AN Nei) Vefeiihebaenl Jey, 
Q) may have been preceded by control of the CPU by Q5 of 
duration Toi alternatively, it may have been preceded by 
der lem statesorecuravi One. s sOnltedutaskealnivecmin Q. 
at an instant when Q) has been in control of the CPU for 
a continuous time duration t, then the probability of there 
being n tasks ahead of this task is 
a n-m+l 


“= 
Ww { 
d qo (m) ) A, (n,iT5+t) A, (n-m-n,+1;t) 


1 n,=0 


n 
+ q, (0) iy. A, (m;A+t) A, (n-m;t) 


tig ChesOuLaGdOn OLsCONCLOLMOLs ches CeUsby. Q) is th 
andetneresUs#uni corm pLlObability OLeatLival Of this Gaskin 
Q., during th then the probability of there being n tasks 
ahead of any task that arrives during time the TREY 

al n+1 tins : 
(1/t,) if > qo (m) ) A, (n,iT tt) A,(n-m-n,+1;t) dt 

0 m=l1 n,=0 

oy 


nN 1] 1 
(GU AE.) 1 q, (0) L A, (m;A+t) A, (n-m;t) dt . 
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presente contro L by Q, Was preceded by control of the CPU 
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by an idle state. Therefore, the probability of there 


being n tasks ahead of any task that arrives in Q. while 
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The expressions for v,(n), V. (n) and v, (n) derived 
above can be used to determine the average length of Q. or 
the expected number of tasks in Q5 at any random instant. 
The probability of there being n tasks in Q5 at the given 


~nstant 2s 


(1-r,)A v, (n) + rT. Vv, (n) + Ty v, (n) 
v(n) = 
T, + rot, + (1l-r.5)A 
(5.4) 
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5-3 Average Waiting Time 


At the time of arrival of a task in Qos (1)2 the Ceu 
may be in idle state, (ii) it may be under the control of 
Qo1 OF #411) 95 tamayebet underiithefcontroltot Q,- The wait- 
ing times for these three possible cases will first be 
examined separately and the results of the three cases 
will then be used to obtain the waiting time for a general 


case. 


Suppose a task arrives in Q. during an idle state 
of the CPU. The average number of tasks ahead of it is 


then 
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u, (t) = (1/2n) f [P, (w)] " exp[iw(t-&,-M,T,)] dw , 


Coo) 


where P, (w) is the Fourier Transform of py (t). 


The average waiting time for the tasks arriving 


during the idle state of the CPU, is therefore 


ig I) ety (CS) Gh: (5.9) 
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If a task arrives in Q5 while Q. TUSPIneCOncrlol sor 
-the CPU, then the average number of tasks ahead of the 


given task is 
Mee) ean v,(n) : (Se 10) 


The average time elapsed from the arrival of this task in 


Q, until the wnextecOontrol of  thesCPumbpy Qus represented 


by €51 is 
E, = T,/2 . | : (oat) 


Since M. does not include the task already in service, the 
probability density us (t) of waiting time t for tasks that 
arrive in Q5 while the CPU is under control of Qos is give 
by 


oe) Mot1 
us (t) = (1/2) [P, (w)] exp{iw[t-§,-M,T,] } CuUycaeen ON ee 


The average value of the waiting time in this case is 
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therefore 


Te eeieceu, (cect es, (5214) 
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Now, suppose that a task arrives in Q. when the 
CPuURT SC =under control of Q,- The average number of tasks 


anead OGethis task ts (then: 


Mo = ty ni Vv, (n) : (5215) 
n=0 


Let bi be defined as the average time elapsed from the 
aGGlvalwOr sche given. taskmunti Wethe nextecontrol] or ithe 


CPUSbDY, Q5- We therefore have: 


a = T,/2 - Coerloy 


The probability density u, (t) of the waiting time for 
tasks that arrive in Q5 dumingeconcrOlmornechesCLUNDY, 
Q,, is 


for) M 
a, Gs (1/20) f [P, (w)] u expliw(t-E-M,T,)] dw , (Saag 


and the average value of waiting time Wy in this case is 
given by 


it 


= J t uj (t) dt . (5.18) 
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Transform of py (t). Somewhat less accurate estimates of 
the waiting times can be obtained with considerable sim- 


plification by using the following approximate relations: 


ey (A/2) + (M;+1)T, + MT, 
i] 

ily (T, /2) + (Mo+1)T, 4; MoT. (Deal o) 
t 

ae (T,/2) aF M,T, + MT, 


As mentioned earlier, the jobs that have just 
received a total CPU time of AL through Q, enter Q5 only 
during the time when Q, 1S i neCOneroOl OLathne Clu wiience, 
the average waiting time for a job to receive its first 
CPU time slice in Q, and that to receive its subsequent 


time slicesewilt be different. We therefore define: 


Wo = Average waiting time for a job to receive its 
first CeUtimne slicesin Q.- 
W, = Average waiting time for a job to receive its 


second and the subsequent time slices in Q.- 
From the definition of Ws Lise CLeo tect t 


We = wo} (5.20) 
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and the probability of their arrival at any time may be 
assumed to be independent of the possible state of the 


CPU. The waiting time W, is, therefore, given by 


2 


(1-r,)A Ww; + r4ToW, + TW, 
WwW, = ——_—_. _.. (Sees) 


2 
Ty + rot. + (1-r,)A 


St! Expected Completion Time in Q, 


The ‘Completion Time in Q,' is defined as the total 
elapsed time that a user job spends in the system from its 


Shaiesiigeal sive Q5 Untill csedepaLrcuresaLrerescomplLetion. 


Suppose that a job in Q. requires its total remain- 
ing processing time iu in n CPU time slices of lengths 
Tyr Tor coer Ty (each < Ao), and also interrupt services 


of time lengths Zyr Zor coer 24° 


If n= 1, the average completion time for job is 
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= CO 


where CAG Musee ierrourier Transrormeot g (Zz). 


Nowe HOrsathnes case whens = So ysthat iis if aljob 
requires three CPU time slices, the completion time for 


Pitt seat aski. co 


and the probability density fate of the completion time 
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Simibearly ~Lomeas | Obethatwrequires: n CPUstime slices 
for its completion, the probability density ihe FOGeLeS 


completion time is given by 
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The expected completion time for such a task is 


therefore 
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she Ts is the total amount of processing time 
required by a jobi on arrival in the system, TA is then 


given by 


where Ay is the amount of CPU time that the job would 
have already received through Qy before entering Q,- Eou.a 
given value of Tor (i.e. the expected number of CPU time 


slices required) can be estimated for a typical task by the 


relation 

(n-1)T, < To-4y <i T. ; (5.24a) 
and for a compute bound task by 

(n-1)A, < To-Ay Ze a) Ao ; (55245) 


US), ae © tere given job the expected completion time 
in Qo: i.e. the elapsed time the task has to spend to 
receive its processing in excess of A,,can be determined 
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Se Expected Total Response Time 


For jobs with the total CPU time requirement less 
than or equal to Ayr the expected total response time is 
the same as E,. (TS /n) Gjiveneby 64.304 jes buL Lore Lhe JODS 
that require a total CPU time more than Ay for their com- 


pletion, the total expected response time e,(T,) is given by 
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€,(T.) = E (A, m4) + EY (75-4, ny) . (5.25, 


The term E (4, ny) represents =the time spent by the job 


boOsreceivetiay total (ePul tameyor AF through Qu: and the 


ik 
term EQ, (T 5A) n,) represents the time to receive its 


remaining CPU time through Qo, in nN» time slices. 


BO ae nee Punceion q,{n) 


While deriving the expression for the average length 
of Qos Enes GuUNnCEION Qo (n) was used without any indication 
of how it could be obtained. In this section an expression 
507 Qo (n) will now be derived in terms of other probability 
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Let us consider an instant when Qy has just released 
COULEO  eOLetiC CPU. sliedts Lie stimerorsethespreviaous release 
ORACHeERERU iby. Q) there was no task in Qos then it means 
EhatesencerpLesent) COnutLOu OLN thes CeUsDy Q) was preceded by 
an idle state of time duration A. Alternatively, if at 
that instant there et one or more tasks in Qor the 
prescuesconueroleoL the, CPUsby Q7 would have been preceded 
byea, GPUMContrompy Q. for a time period tor and during 
helganics texejagenaeml 1eyt, Q5 exactly one task will be processed. 
Hence, the probability of there being no tasks in Q, at 
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Using the probability densities of ty and te and rearrang- 


ing the resultant expression, we have: 


G5 (0) - q, (0) J Ay (07t,)A, (O7Att,)p, (t,) dt, 


gq, (1) == 


t hi 
ik f A, (07t,)A, (0; ty tt, )h, (t,)py (t,) dt at, 


(526) 
Similarly, the expression for the probability of 


there being (n-1) tasks in Q5 at a given release of the 


GPRUBDY Q, is: 
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PNeSeQualLTOnsm(o.20) and s(oe27)) Make it possible 
to evaluate the function qo (n) provided the value of qo (0) 
is known. The value of Qo (0) can be determined by using 
the fact that 

co 

— qj(n) = 1. 

some timesechesevaluation OLsintegqrals in, (5.26) and 
(5.27) may be quite difficult, and in that case the follow- 


ing approximate relations may be used”: 


olO) = GES) 2S rae hae opteul 


qo (1) Ss t 1 " t Uy (67. 28) 
A, (0;T,) A, (0;T,+T) ) 
and 
n=1 1 " iii u 
Qo (n) = qd, (n-1) = Qo (0) ao A, (mT, ) A, (n-m-1;A+T, ) 
n-1 aie : 
ieee (ee) eer, CMA (non m7 05 nS) 
n,=l1 m=0 
ay 
: ; (6.29) 


t t u" t 
A, (0;T,) A, (0;T,+T,) 


With the derivation of the above expression for qo(n), 
all the parameters for Q5 derived earlier can now be deter- 
mined. Thus, this completes the analysis of the model 


described earlier in Chapter III. 


y See pages 40 and 42 for T and Ty respectively. 
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CHARTERSVE 
APPLICATION TO CASE OF EXPONENTIAL DISTRIBUTIONS 


Oe New DL Str bution Functions 


The results of the earlier analysis will now be 
applied to a case where the various distributions are 
assumed to be exponential. First let it be assumed that 
the probability density of interarrival time for the new 
jobs entering the system Ae Ay exp(-\,t), where hy is the 
Mean arrival rate of such tasks. The fLunction A, (n:t) is 
then given by 


d exp (-A,x) A, (n-1;t-x) dx 


(aie) AS (nt), = hy 
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Similarly che other inpuesdisteribucion functions are 


assumed to be as follows: 
Gay AL, (net) =" (6, ) 7a eee(-6,8) (6.2) 


where oy is the mean arrival rate of tasks into Q1 from 
the interrupt server during the time when Q, has control 
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where o> is the mean arrival rate of tasks into Q, from 
the interrupt server during the time when Q1 does not 


havescontrol of the CPu. 


(iv) Aj (n;t) = [(,t)"/n!] exp(-a,t) (6.4) 


where Ay is the mean arrival rate of jobs that enter Q5 
for the first time after having received a total CPU time 


Ay through Qi: 


(vy) A, (mrt) = [(p,t)”/n!] exp(-$,t) (6.5) 


where b> TSecleaMeanmabnLeval euadtomOuslask so elicO Q5 from 


the interrupt server. 


Let us further assume that the service time density 


functions h, (t,) and hy (t,) are as follows: 
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0 elsewhere 


A 
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(ie) 


JA 
(ees 


Coy exp (~u,t,) FOR Sst 5 
h(t.) = (6x 7) 
0 elsewhere 


wovl .O ofnl adeed to atns levteee oe ens al” o* 
es eegty ph, Feast: ans) wid cuezerat rertes  2quxzednt oad 
La wit Yo fexsdaco ove 


t 


+. (+) f=) one T ed, 7 : (Yon) ca (wt) 


iw oie o£ gh orstw é: 


i £ ’ 
: 


oy b Dag teoot eaivats ved te atid. desk) ents ee 


9 nipvords com 


- 


(T " 
y Ligh Cpe) )] = (9 7np A tv) 


ROD Vl iat levigghs ogee edt okie ee —_ 
W / t « > b 


Vier sqnitedat eng 


to it il) 2iipege taitzagd en de 
t) th teen (poh pt eaotsone2 
i t i= Pha! & ~ 
pt 3 : pT pu faye sys 
(a3) 


a SviWvewhe 


<= 


a 


Be te? ws) twlht (ove t635n2\ on 
v | F 


_— 


70 


where Co is’a normalizing factor. given by 
Coeuel Alec exp(-pA5)] - (6.7a) 


The probability density g(z) of the interrupt service 


time may be assumed to be 


G(z)9= Beexp (- 82) 


where 8 is the mean rate of interrupt service. 


6.2 The Parameters for Q 


The average duration of continuous control of the 


CPUSby astask in Q, aS 


co A 
AL = S ty h, (t) dt, ae t) fyb exp (-y,t,) dt, 
= (1/u,) - ¢,A4 exp(-njA) , (Guo) 


and the average duration of continuous control of the CPU 
by a task in Q5 is 


(ee) 


A 
a } 25 WalGesy) hes, = ! t, Col, exp(-u5t,) dt, 
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The Functions q, (nit) and A, (nit) 


The function q, (nit) is given by 
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The Function S, (nit) 


The function S, (n7t) represents the probability 
thatenetasks in Q, Will Controls the CPU Lor a continuous 


Eimewduratiom t. § Ltvis, therefore, given by 
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Due to the discontinuity in the function h, (t) at 
te=(A, the derivation of S, (nit) becomes very complex and 
is given in the Appendix. The resultant expression ob- 


tained for S, (n;t) is as follows: 
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Ay 


where p(n) = f q, (nit) hy (t,) dt, rs 
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and the average duration of such continuous control of 


Ener Ceres 


pe et igre) eke 
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BymeSUDSELtuting the values, offvarious functions: in the 
above expressions, we have 
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Now we consider the case that the present control 
of the CPU by Q) was preceded by an 1dle state. The pro- 
bability density of duration of continuous control of the 


CPUSby. Qa, Metirismcase, 1s: 


o mM 
p, (t) = KA I d q, (n;A) S, (m;t) A, (m-n;t) 5 
m=l n=l 


and the average duration of such control is 


On substituting for various functions and evaluating the 


integral, we have 
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where K, (m,n) VS given by the expression (6.22). 


Now knowing the values of oe and The the average 
duration Of the ‘continuous control of the CPU by Q1 an 


general case, given by 
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can be determined. 
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A> t 
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foe) fore) iL , 

Wi, = AS ) a [p, (t))/t,] dt, i Beene sey) 1she 
n=0 0 
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In order to avoid the complexity of evaluating the double 
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where m = nt+2nj-nj-m,-1 


Hence, the expression for Wi becomes 
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Weta n Qo ( 47h) ee By es 
eZ Ti n=0 naa Eel eae 2 (ntn, no)! De ae 


(67213 61) 


The value of Ww, may be obtained by substituting Wil 


and w from, (6.35) endw(6.36) st nbOsedUalLtonm Greco) eae 


eZ 
average waiting time Wy may then be determined by using 


the values of Wir Wor and Wy Tee be bacon. tOn (6. 26). 
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The Average Length of Q) 
The average length of Qu: represented by Ny is 
given by 
(Toga) ) n £. (n) Sp alld i n £. (n) athe ) n f, (n) 


n=0 oe nko n=0 


(6tsay) 


where £,(n), f£. (n) and £, (n) are’ given by (4.16), (4.17) 
aniom (4529) erespectively. | By substituting sthe values of 


various functions in the expression for f,(n), we have 


co foe) A 
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= (1/A) J ae, D pages) lel aes ney She 
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In order to evaluate ) n f,(n), the expressions 
n=0 
LOG Wii and Wi given by (6.35) and (6.36) may be used. 


Since for Wiqt Wy9 and £, (n) we have 


©O 


' 

Wey e ) Dyes 

n=0 
Wey = Ns ) n £,(n) , 

n=0 

and 
= t £ ul 

£, (n) = 1, £, (n) me (Gi r.) £, (n) ; 


therefore, 


nF n £, (n) = r,(w,,/A,) + (1-r,) (w,5/A,)- (6.40) 


Hence the expression for the average length of Q, 
becomes: 


_ [(lerg) (82/2) +32(05/2)1 405) + [xgwyy+ (lrg) Wy 9] (T/4,) 
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1 A cide Bape 


1 ato + (1-r5)A 


(6.41) 
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where 


G(w) = G(Z) exp Giz) edz 


om 8 


Substituting the value of g(z) in the above expres- 


SPOnmrom Gay), yields 


[e-e) 


G(w) = f 8 exp(-8z) exp(iwz) dz 
0 
=I AGIA ae she (6.42) 
Hence, 
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—=0O 


On integrating by Residues, we get 
gore T(t -nw,-T_)" 7/(n-2)!] exp[-g(t_-nW_-T_}] 
i is gS : P re rs / 
Venue) Oe nW, tT. (Ga) 


0 2%, otherwise 


The expected response time E,.(T 5 -n) LOLeA sj Obmchat 


reguires its processing time TT. injn tines slices;eais 
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B (Tn) = J © eee! dt. 

exp[-8 (t,-nW,-T.) ]dt_. 


(6.44) 
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poset Cuiingax a= tL. = (nW,+T_) leads to 
Eaten) ier (noo J (x+nW,+T.) xno? Crxpi—ex eax 
=n 7G (nW,+T.) : (6245) 


Theyvalucwofl nelor a typicaly 70b) can be*estimated 
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6.3 The Parameters for Q, 


In this section the expressions for the parameters 
pertaining to the queue Q. namely (i) average length of 
Qo: (ii) average waiting time, and (iii) expected comple- 
€i10n time inf Qo. will be derived for the case with exponen- 
tial arrival and service time distributions. Due to its 
Use sin the derivation of other expressions, the function 


qd, (n) Will be considered) first. 


The Function q5{n) 


The general expression for dy (n) was derived in 
section 5.6. Due to the reasons of simplicity we shall 


here use the approximate relation which is as follows: 
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SN) ALL WS MOEN | Pete 


n-1l 
{q, (n-1) = qo (0) cts A, (mT, ) a oom ts) 
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n,=1 0 


Heke Ge ps 7 : 
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Substituting the exponential forms of the input 
Giseri bution L1uncti1ons, we Obtain 
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Equatrons ((6246a) ande(6.46b6) can be used to obtain 
values of qd, (n) for all ng Wegprovided the value of Gy (0) 
is known. The value of qo (0) can be obtained by using the 


Pactethat ae.) Q(T) asedse 
n=0 


Average Length of Q5 


The average length of Qor or the expected number of 


tasks: in Qos is given by 
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and the function qy (n) is given by (6.46a) and (6.46b). 
The average length of Q1 can now be determined by 

MeansmOfsecquattonse:(6.47) through (6..51). 

Average Waiting Time 


The average waiting time for a job in Q. to receive 


Pescmorrst Clrumstime. Ss 1cerlls 


and that to receive its second and the subsequent time 


siaces is 


Wo [ (1-r,) Aw, + beets + Tig / tlt ceed a Ula ME (GS 502) 
where 
Wi SPAN 2a Mil) Cg (6.53) 
Wo = Ly/ 2)e (Mel) Dace Da, (6.54) 
and Wi 2 (by eipesh alien? We) : (6.55) 


Completion Time in Q. 
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Ine CIMNesS LEces, 4s 


ae 2 Gem I Teo exp{iw[t -W,-(n-1)W5-T1] }dw 
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(6.56) 


WhielLesGiil) eis = thestourier Transform or ¢g(Z). “Since gz) “= 
PeCxXDi-62)),) tne! Fourier Transtormm Giw) of the functyron g(z) 


is given by 
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G(w) = f 8 exp(-8z) exp(-iwz) dz 
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Hence, the expression for ¥, ee? becomes 
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(6.58) 
The expected completion time for such a task is, 
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ioe) 


4 ! —_ : 
Ej(Ton) = J ee ce ecie 


fan ihre leet [W., (Gea ih es a ; (6059) 


Aeminotcatcdmearlienr, thervalvewof Nn tor atypical 


job can be estimated from the relation (n-1)T. < ib < nt,, 
S 


and for a computebound job from (n-1)A, < ios ni.. 


6.4 Numerical Examples and Discussion 


In previous sections expressions have been obtained 
for certain quantities such as the average waiting times, 
expected response time, average length of Qu, expected 
completion time in Qos and average length of Oe in terms 
OmevcialOUsmoyclLelmpandMict eto ml NCcome x OLOSS Ono taken gudaie 
complex forms and, in order to demonstrate their character, 
it is necessary to consider some numerical examples. 
Therefore, numerical results based on assumption of parti- 
cular values of parameters such as quantum size, mean 


arrival rate, mean service rate, etc. are presented in this 


section. 


The values of A, Ayr dou My and § are assumed to 


be as listed below. The unit of measurement is 1 second 


throughout these calculations: 
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The parameters Ay and A, are varied over a certain range 


during the calculations. 


itece clear that d and 9, will depend upon the 
value of Aye and 5 will depend upon the values of ho and 
Ao*. However, in this study no attempt has been made to 
determine this i RSPAS analytically; instead, the 
following relations are used to take into account the 


dependence of oP and oF on i ancdethiateoe b> One anc 


ay 2 


Ih 
Z 


d= Ay /2 ’ 7 = 2hy 


Dey SO OVI ei VA) 


Clearly other equations could equally well be assumed but 
it is believed that the above are not unreasonable and 


will serve to illustrate the general approach. 


Because of the dependence of certain intermediate 
Quantities, ons the others, iters mecessarystondostnercal— 
culations in the following order: 


(lL) mee alcula le T! and T" (the average duration of con- 


1 i 
GintousmCOntbo WeOLmLneeCPUMDY, Q) after it receives 


tee OM Qo, and from an idle state of the CPU). 


* 
See page 52. 
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(11) Calculate ro and Qo (0) using the values of Ho and 
1 obtained above. 


(i111) After ro has been obtained, other quantities such 
as waiting time, average length of Q) and Qor 
expected response time, and expected completion 


time in Q. for any given job, may then be calcu- 


7 lated. 


The estimation of qd, (0), and hence Loe is not 
straighttorward. The relations (6.Aba)wand (6. 46b) sallow 
computation of q. (n) DY = reCcuns1OneLor=sn 2 , spcrovided 
Qo (0) is already known. As was mentioned earlier, qo (0) 
can be obtained by using the fact that ae Qo (n) must be 
equal to 1. A graphical method provides an easy way of 
obtaining Qo (0) and may be performed as follows: Starting 
Witheagbitrary values of qo (0) (OE _Ccounse Wess than 1), 
a die and then ) q5 (n) may be calculated, from which a 
graph may be epee to relate } qo (1) RCO qo (0). From 
this graph may be read the value of q, (0) which makes 
} dy (n) ieee Witiieecii. ow Vial lemon Gy (0), r. may then be 
obtained since ro = hoe Qo (0). Fig. 6.1 shows’ the plots 


of d Gy (n) against Go (0) for various values of A, and hi: 


All the numerical results are presented in graphi- 
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oh) 


between the expected completion time, E(t .n). in Q., 

and the remaining service requirement tee The results 
elesO0ta il neds rformtne compute, bounds Obs. | The results 
indicate that both the dependence of E (TS .n) on T. and 

of iS Ae ase) on i are linear, and also that an increase 

in hy results in an increase in both E(T,/n) and Bah Urge) 6 
Such is to be expected since an increased arrival rate 


implies more waiting for the jobs and hence slow response. 


DNezehrecteOnevarlatlonain Ay on expected response 
time, and the expected Bane een time in Qos TOGA soi xed 
amount of service requirement is shown by the curves of 
(nei Gwe) ebatel Wiehe he Wares vay the elapsed time to receive 
a certain amount of service through Q1 is less than the time 
to receive the same amount of service through Q5- But with 
the increase in Aor EB. (T, en) decreases whereas E (Tn) 
increases, and after a certain point the jobs in Q. are 
serviced at a rate faster than the jobs in Q,- The rate of 
change (one Jefeneis) E,. (TS /n) and E (TS /n) decreases as A. is 
increased. At A,=1.25 A, both E,(Ti,n) and E,(T,,n) are 
equal, indicating that on the average the jobs in Q. receive 
the same service as those in Qu and the effect of lower 
PELOn Gy nO Q5 is compensated by its larger time slice. 
However, this is true only for the jobs: with larger service 


requirement, and the situation is expected to change with a 


change in A, OF Ay- 


haguresmsosGaand, 6./ esiow the effect of variation 


in Ay and A. on the average lengths of the two queues. As 
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Fig. 6.4: Expected total response time as a 
function of service requirement. 
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is to be expected, the average length of Q1 increases 
considerably with an increase in hi: However, a varia- 
fa One 1 Ay has a small effect on the average length of 
Qy which increases relatively slowly with an increase in 


Ay: 


An increase in A, has an opposite effect on the 
lengths of the two queues. As A. is increased, the average 
length of 25 decreases, whereas the average length of Q1 
tendsmetognecreasers | Thisicis checause lanitincrease iin A, 
results in faster servicing of jobs in Q, which then leave 
theiesystem Sy Om «the otherwhand prits effect fon Qy is that 
once Q, mecemosmcontrolcofethetiGRUig Lt etetains cit tion a 


longer period of time, thus causing an accumulation of a 


greater number of jobs in Q,. 
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CHAPTERGVIL 


CONCLUSIONS AND SUGGESTIONS FOR FURTHER WORK 


In most of the earlier analytical studies of time- 
sharing computer systems the interarrival and service time 
distributions were assumed to be exponential. Such assump- 
tions, although valid in certain instances, may be ques- 


tionable in many others. 


The analysis presented in this thesis does not 
assume any particular form of distribution for interarrival 
and service times. The arrival and service processes are 
described by means of general probability functions which 
may be determined for the particular distribution that 
best describes the process. Thus the analysis is general 
in nature and may be applied to any system that uses the 


same type of queueing discipline. 


As a particular example of application of the present 
analysis the special case of exponential distributions has been 
considered. The qualitative behavior of the numerical results ob- 
tained seem to be reasonably in agreement with earlier work done 
in this area. While simulation techniques might be used to pro- 
vide a further check, it is believed that such is beyond the scope 
of the present work and would, in fact, place undue emphasis 


on the specialization to exponential functions. 
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The assumed mathematical model contains two queues 
of user requests or jobs designated as Q, and Q,- Each 
job entering the System is given a fixed maximum amount 
Ofeprocessing time through the higher priority queue Q, 
in a round robin manner, and if the job is not yet com- 
pleted it is placed in the lower priority queue Q,- The 
jobs in Q5 are processed again in round robin manner, but 
only when Qy is empty. A reason for selecting this model 
PemDeCauscsOms1 CSoaSUPeCLIOri tye Over tne rounds robin (RR) 
model as it gives higher priority to newly arriving short 
jobs in contrast to those that have already received some 
fixed minimum amount of service. Also, this model is 
somewhat less complex to analyze tiian is a miultipie level 
feedback (FB) model. However, its analysis can be modified 
easily to that for Serres the RR model or FBY model. Another 
advantage of this model is Hey ea selecting a larger time- 
slice A, GOGet nen | OoSmin Q5 the overhead due to swapping 


may be reduced without an undue increase in the response 


time for the jobs in Qi 


The swap time in the present study has been assumed 
to be zero but, it may be taken into account by assuming 
ieaeouDemas sina lle fixed portlon OLethcmuilnemouacer. 


In the present analysis, the functions Aj, (nit), 


Ayo (nit) and NMEA) 5 that describe the tasks input to 
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Q) and Q5 from the interrupt servers, are assumed to be 
independently determinable. But it should be possible, 
and is believed to be important, to determine these func- 
tions in terms of other more basic functions such as 

A, (nit), h, (t) and g(zZ). The determination has not been 


attempted in the present study. 


Watuta lly aswinvany alvalvysis such asuthisswhicn 
attempts to be general, many expressions become quite 
complex. However, they are still manageable, and the 


approach deemed worthwhile. 


As an extension of the present study further work 


is suggested as outiined beiow. 


(1) The assumed model may be extended to include a non-zero 
Swap time. The effect on the system performance under 


Various = Loading conditions should be studied. 


(2) The present analysis should be used to obtain numerical 
results for a non-exponential arrival and service time. 
Furthermore, the variances of the various quantities 


considered should also be determined. 


(3) An analytical study should) besmade of= the muller piles lever 
feedback model with, and without, priorities. The same 
approach as in the present thesis may be used. The 


alelVciceOuetiewnaghestspilority queue 1 FBy model 
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would be essentially the same as that for Q, in the 
present model, but the other queues may have to be 


considered somewhat differently from Q.- 


(4) It may be worthwhile to check the results of the 
analysis by simultation thereby confirming the vali- 


dity of the analysis. 


Before proceeding to further study as outlined above 
it would be useful to consider methods for approximation 
of some of the more cumbersome expressions derived in the 
present thesis. The purpose of the present study has been 
the development of general equations and verification that 
the resulting numerical Computations are feasible. It 
would, however, be very useful to derive some analogous 
approximate relations that could be computed easily and 


without loss of generality. 
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APPENDIX 


The Function S, (nit) 


The function S, (n;t) is the n-fold convolution of 


h, (t) with itself and is given by 


S, (nit) = (1/2) f Hw) exp(iwt) dw (1) 
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where H(w) is the Fourier Transform of h, (t) given by 
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First the expressions for S, (it), S, (2;t) and 
S, (37t) will be derived and the resulting form will be 


generalized to obtain an expression for S, (nit). 


an Gre 


The function S, (lit) is defined by 


(1/27) f{ Hw) exp(iwt) dw 


— OO 


S, (17%) 


h, (t) [From the definition of H(w) ] 
) 


Therefore, 


ba 


tanievaon bhoten arly sf (gtn) 2 teligtwt off 
: . 7 ‘a. 
cl aevte a) Bos Diwan? ddiw (3) pal 


& 
(1 b (tuehges (Oe \ (wit) = (4a) 8 


(@) =< 7 

_ 

isvige (dt) -t lq uteteaseT toecseed a2 ak (oe Soe : 
= a 

ee | 

Ue 

A ; 7 

th [o i, + a 6” 3 — 

a ad } os) a a 

a * ~ ~ & . . “>? <= © *_ + 7 


(cj  £ tA: eit) =] 949 Cd toes © WN pty) as 


hig (4-4) (3 li (1) .& 302 20eAreegzeate etigy easly 7 


3 


[lLiwo mot prise iueass eat bee ay topes od itiw Ne 
-(tta). 8 tot sotdesadts fe Riagiie. of bes i laxonep 


= 
_ 

sa = 

a 


td Sentioh a& Gibbs acktanal 
nd di: 


v UD 
_ , 
vo ny 


7 


v 


114 


Om; ct toe) 
S, (1;t) Seas exp (-y,t) : es thes Se eI 


Oar if BASFO FE 3 (4) 


(2) S,(2;t) 


BEOE the, function S, (27t) we have . 
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This integral may be evaluated by using the theory 
of complex variables with contour integration around a 
semi-circle in the complex plane. The semi-circle is 
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The separate steps of the integration are described below. 
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Por t > 0,,the second term -=0 as R > ©. Therefore, 
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where » Res is sum of the Residues at all the poles of 
the function tin the lower half of the complex, plane: 


Since there are no poles in this region, the above inte- 
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(c) To integrate the third term of equation (5), con- 


sider separately the two cases when t > 2A and t < 2A. 
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Substituting the values of integrals from equations 
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The function S, (3;7t) is given by 
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Proceeding in a Similar manner as for S,(2it), the 
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Substituting the values of integrals from equations 
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Now the results for S, Git), S, (2; t) and S, (37%) may 
be extended to a general case. From equations (4), (12) 
and (22), the following expression for S, (n;t) is obtained 


by inspection: 
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